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Abstract 

A class of models with applications to swarm behavior as well as 
many other types of spatially extended complex biological and physical 
Q systems is studied. Internal fluctuations can play an active role in the 

{—I organization of the phase structure of such systems. Consequently, it is 

^Pp not possible to fully understand the behavior of these systems without 

^/ explicitly incorporating the fluctuations. In particular, for the class 

CO of models studied here the effect of internal fluctuations due to finite 

size is a renormalized decrease in the temperature near the point of 
spontaneous symmetry breaking. We briefly outline how these models 
can be applied to the behavior of an ant swarm. 

In this paper I introduce a class of models which is in line with the 
basic processes acting in a variety of systems in nature, particularly bio- 
,_j logical ones. Some systems which fall into this class are insect swarms, 

^ swimming bacteria and algae, [6] physical trail formation, the evolution of 

river networks, [7] diffusive transport in polymeric materials, [1] population 
distribution models, various types of fractal growth phenomena, [13] and de- 
velopmental morphogenesis. [11] 

Here we study what will be called stigmergic processes as a generaliza- 
tion of the concept of stigmergy introduced by Grasse[3] in the context of 
collective nest building in social insects. The hypothesis of stigmergy, as 
described by Wilson[14], is that it is the work already accomplished, rather 
than direct communication among nest mates, that induces the insects to 
perform additional labor. The concept of stigmergy has also been invoked 
more recently in regards to swarm behavior. [12] 
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The more generalized idea of a stigmergic process is realized here in 
systems composed of three basic ingredients. The first ingredient is a particle 
dynamics which obeys a Markov process on some finite state space X. The 
particle density p(x, r) obeys the Master equation 



dT 



I {Wr{^\y)p{y, r) ^y,(y|x)/>(x, r)} d^y, (1) 
Jx 



where VFT-(xjy) is the probability density to go from state y to x at time 
r. The second element is a morphogenetic field C7(x, r), representing the 
environment which the particles both respond to, and act on. We will study 
one of the simplest situations, a fixed one-component pheromonal field which 
evolves according to 

' =-Ka + vp, (2) 

where k measures the rate of evaporation, breakdown or removal of the 
substance, and rj the rate of emission of the phcromonc by the organisms. 
Lastly, some form of coupling is made between the particles and the field. 
This coupling takes the form of a behavioral function which describes how 
the particles move in response to the morphogenetic field, and in turn, how 
the particles act back on this field. 

As we shall see, small changes in the microscopic behavior of the par- 
ticles can result in large changes in the global behavior of the swarm, or 
particle field. This variability has significant implications not only for the 
behavioral response of the swarm to external stimuli, but also in the evolu- 
tion of cooperative behavior. Wilson has remarked that an understanding 
of how this occurs would constitute a technical breakthrough of exciting pro- 
portions, for it will then be possible, by artificially changing the probability 
matrices, to estimate the true amount of behavioral evolution required to go 
from [the behavior of J one species to ... that of another.[14\ He has further 
remarked that such large behavioral changes resulting from small changes in 
the individual dynamics would provide evidence that social behavior evolves 
at least as rapidly as morphology in social insects. This could provide an 
explanation why behavioral diversity far outstrips morphological diversity at 
the level of species and higher taxonomic categories in social insects. 

In the region of a nonequilibrium phase transition the morphogenetic 
field, and hence the transition matrix, changes very slowly on scales typical 
of the particle field relaxation time since in this region the unstable modes 
will exhibit critical slowing down and will relax on a time scale much longer 
than the time scale of the stable modes. The particle modes are said to be 
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slaved to the morphogenetic field, and can be adiabatically eliminated from 
the picture. [4] We obtain the stochastic order parameter equation 



da{x, t) 



= K a + r]ps[a] + rj g[<T]^{yi,T), 



(3) 



where Ps[o'] is the quasi-stationary particle density, g[a] is a function de- 
scribing the fluctuations of the quasi-stationary particle density about its 
mean value, and ^{^(x,t)} = 0, £;{^(x, t)^(x', r')} = ^(x - x')5(r - r'). 
Since ps will depend on both the global state of the morphogenetic fields, 
and on the global boundary conditions, this is a globally coupled set of equa- 
tions for the evolution of the morphogenetic fields. Slaving of the particle 
field therefore allows an explicitly coupled global dynamics to emerge from 
the strictly local interactions of the model, providing a key to how a globally 
integrated response may emerge from a system of locally acting agents. 

The the fluctuations in the system are state dependent. In addition 
to amplifying an instability which exists in the absence of noise, this type 
of fluctuation can also produce transitions and ordered behavior in its own 
right. One of the consequence of this fact is that slaved particle field will con- 
structively determine the self-organization properties of the systems through 
its fluctuating properties, as well as through quasi-stationary values. This 
is a fact which should be constantly be born in mind when studying such 
models. 

For the purposes of this paper we will consider the case where the 
transition matrix takes the form Ty(x|y) oc / (o"(x)) j» (|x — y|), where / 
is some weighting function describing the effect of the field a on the mo- 
tion of the particles, and p (|x — y|) is a probability distribution of jumps of 
length r = |x — y|. Transition matrices of this type obey detailed balance, 
Ty(x|y)/(cr(y)) = VF(y|x)/(cr(x)). In this case we can define a partition 
function 



where V is the volume of the state space X, and N is the total number 
of particles. A one-to-one analogy with a thermodynamic system with en- 
ergy [/(fj(x)) and temperature T = (3~^ can be made if we set /(a"(x)) = 
exp (— /3J7((j(x))), where any parameter T can be regarded as a temperature 
parameter if /(cr(x);a T) = /~'*(cr(x); T). Statistical quantities of interest 
can be calculated from the partition function according to the usual pre- 
scriptions. In a closed system the mean particle density and dispersion in 
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the energy state e are given by 

E{P.} = ^exp(-/?e), £;{(Ap,)^} = ^ (l - , (5) 

where /ie is the vohimc of the system in energy state e. The slaved parti- 
cle field in energy state e can then be represented, to lowest order in the 
fluctuations, by p,[<t] = E {p,[<t]] + {(Ap,P[o-]} ^(x,t). 

We introduce the dimensionless parameter p = N/V, the mean density 
of particles, and v = ji~ / pf^ , the ratio of the volume of the field (t(x) in 
the a~ state to the volume in the state. We also define the function 
R{a^,a~) = f{a~^)/f{a~). In the mean field approximation a Langevin 
equation 

dfji 1 

-m + F{m) + -^Q{m) ^{t) (6) 



dt ^ ^/N 

for the order parameter m can be derived, [10] where 

Rf^ + v V [Rf^ + v)"^ 

and where the F and Q are determined as functions of m by 

i!W=ii(p+^,p-— ). (8) 

The order parameter m is analogous to a gas-liquid order parameter, and 
represents the difference in the values of the field in the and a~ states 
after spontaneous symmetry breaking. The behavior of this system is de- 
scribed by the potential function 



, m- Fim) , 1 , ^ 



where the phases rrii of the system are determined by the conditions $'(mj) = 
0, $"(mi) > 0.[5] 

In the continuum limit {N — ^ oo) it can be shown that the critical value 
of the mean density pc at which spontaneous symmetry breaking occurs is 
given by the condition —pc U'{pc) = T. Generally pc is will increase with 
increasing temperature. The relative stability of two phases mi and m2 is 
determined by the relative potentials $(mi) and $(7712) for each phase. Even 
in the continuum limit the details of the fluctuations cannot be neglected due 
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to the presence of the factor Q'^{m) under the integral in 9, and the relative 
stability of the phases will depend on the precise details of the internal 
fluctuations. Similar observations have been made elsewhere by Landauer 
and others. [8] 

When N is finite, the situation is still more complicated. It is clear 
that the possible values of the order parameter and the phase structure 
do not remain unchanged under the influence of internal fluctuations. The 
criterion for spontaneous symmetry breaking in this case is —pc U'{pc) = 
T, where T is the renormalized temperature T = 'y(N)T where 7(A^) = 
^/N + {N/2Y — N/2. This is precisely the continuum condition except that 
the finite size fluctuations have the effect of renormalizing the temperature 
by the factor 7(A^) < 1. The effect of increasing the internal fluctuations 
through decreasing the total number of particles has the effect of decreasing 
the temperature. We thus arrive at the seeming paradox that increased 
internal fluctuations may produce increased order. 

I will now briefly outline how the previous analysis can be applied to the 
example of an ant swarm. More details can be found elsewhere. [9] In this 
case the individual ants are the particles, and the morphogenetic field is a 
pheromonal substance which the ants sense with their antennae, and emit 
from their bodies as they move. The basic measurement the ants make is 
the quantity of pheromone receive by each antennae. They can therefore 
respond to difference in the pheromone between the antennae, and move 
accordingly. A very general model of such motion assume that the particle 
experience a force which is proportional to the scent gradient at that point 
multiplied by some nonlinear response function x((t) of the scent at that 
point. The nonlinear response function models the nonlinearities underling 
the basic physiology of the sensing apparatus, for instance, any nonlinear 
neural/receptor response to the pheromone, including such effects as satu- 
ration of the receptor sites on the antennae by the pheromonal substance. 
In addition there is an element of randomness due to fluctuations in the ex- 
ternal environment as well as internal fluctuations. These are incorporated 
into an effective random force with a strength in proportion to \/T where 
T is the temperature factor. The motion of a particle can be described by 
a Langevin equation of the form 

^=x(^(x))Va + V2Te(t), (10) 
where E {^{t)} = 0, and E {^{t)i{t')} = 6{t - 1'). This can be written in the 
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form 

^ = -VC/(x) + V^e(t), (11) 

where x(o'(x)) = —U'{a{x.)). Easy to show that the behavioral function of 
such a system is given by /(a) = exp{—fjU{a)). 

The microscopic dynamics of the ants which we will study in the rest of 
the paper is determined by the response function 

X{a) = a + ^, (12) 

where p is the pheromone density, and a and c are constants with the units 
of pheromone density. This function is inspired by the observed behavior of 
actual ants [2]. The constant a is roughly the threshold where the response 
of the ants to the pheromone is small unless p > a. The constant c will be 
known as the capacity. When p approaches c the ants respond less accurately 
to pheromone gradients. This is because when the pheromone density is very 
large the antennae receptors become saturated and the ant can not sense 
the pheromone gradient as accurately. 

For simplicity we will introduce the dimensionless variable a = p/a 
and the dimensionless parameter 6 = a/c, where 1/(5 is the dimensionless 
capacity. The energy function takes the form 

where we drop off any additive constant term, which have no effect on the 
behavior of the ants. For the case where the density of ants it low, and hence 
the pheromone density is low (p « g), we can make use of the approximate 
energy function J7o(<7) = — ln(Q; + a). 

An illustration of this effect is shown in Figure 1. A given current of 
organisms / flows into a junction from the left. On the lower branch the 
pheromone density is fixed at (Tq, and on the upper branch a is allowed to 
vary. T{a), the proportion of the current which flows into the upper branch, 
is given by the sigmoidal function 

T{a) = [1 + exp {pU{a)/Uiao))]-' . (14) 

The plots on the right of Figure 1 shows T{a) for varying values of f3 and 
6. The upper plot, where 6 is fixed, shows the influence of increasing the 
temperature (lowering /3). As the temperature increases the threshold re- 
sponse becomes less and less pronounced. In the opposite limit (3 ^ oo, 
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Figure 1: Transiton functions for varying /? and b. 
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Figure 2: Effective temperature factor 



T((t) would be a step function Q{a — gq). In this limit all of the ants would 
choose the branch with the greatest pheromone density. In the lower plot 
the noise level is fixed, and the capacity c = a/(5 is varied. It is interesting 
to note that the effects of decreasing the capacity with fixed temperature 
are similar to the effects of increasing the temperature with fixed capacity. 
When the density of the ants increases, the pheromone density increases up 
to and beyond the capacity, the qualitative effects on the behavior of the 
ants is the same as if the temperature was increased. This gives the swarm 
roughly the ability to modulate its temperature by modulating its numbers. 

This can be made more clear by defining an effective temperature factor 
6{a) through the relation f{a) = exp{—pUo{a)/0{a)). 9{a) roughly mea- 



7 



sures the effective change in temperature as a function of the pheromonal 
field when compared to the case where 6 = 0, which correspond to the energy 
function Uq- The effective temperature is then given by 9{a)T where 



Fig. 2 illustrates the increase in the effective temperature with increasing 
a for three different values of 8. Since increasing the temperatmre tends to 
decrease stability, we might expect any organized behavior to breakdown 
when the number of participants grows too large. It is this ability of the 
swarm to self-modify its temperature which allows it, in a sense, to traverse 
its various phase transition boundaries. 

Figure 3 is a typical phase plot for the ant swarm illustrating regions 
of homogeneity, bistability and hysteresis. The plot illustrates the effect 
of behavioral and swarm parameters on the swarm as a whole. In this 
case (5 is a behavioral parameter which could be expected to change on 
the evolutionary time scale, and 7, which is proportional to the number of 
participants, is a swarm parameter which determines the behavioral "phase" 
of the swarm. More details may be found in previously published papers [9] 
where the properties of an ant swarm are analyzed in depth, and it is also 
shown how the collective behavior of real ants [2] can be understood in terms 
of such models. 
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